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Experimental  Demonstration  of 
Adaptive  Infrared  Multispectral 
Imaging  using  Plasmonic  Filter 
Array 

Woo-Yong  Jang1'2'*,  Zahyun  Ku3'*,  Jiyeon  Jeon4,  Jun  Oh  Kim4,  Sang  Jun  Lee4,  James  Park1, 
Michael  J.  Noyola1  &  Augustine  Urbas3 


In  our  previous  theoretical  study,  we  performed  target  detection  using  a  plasmonic  sensor  array 
incorporating  the  data-processing  technique  termed  “algorithmic  spectrometry".  We  achieved 
the  reconstruction  of  a  target  spectrum  by  extracting  intensity  at  multiple  wavelengths  with  high 
resolution  from  the  image  data  obtained  from  the  plasmonic  array.  The  ultimate  goal  is  to  develop 
a  full-scale  focal  plane  array  with  a  plasmonic  opto-coupler  in  order  to  move  towards  the  next 
generation  of  versatile  infrared  cameras.  To  this  end,  and  as  an  intermediate  step,  this  paper  reports 
the  experimental  demonstration  of  adaptive  multispectral  imagery  using  fabricated  plasmonic 
spectral  filter  arrays  and  proposed  target  detection  scenarios.  Each  plasmonic  filter  was  designed  using 
periodic  circular  holes  perforated  through  a  gold  layer,  and  an  enhanced  target  detection  strategy  was 
proposed  to  refine  the  original  spectrometry  concept  for  spatial  and  spectral  computation  of  the  data 
measured  from  the  plasmonic  array.  Both  the  spectrum  of  blackbody  radiation  and  a  metal  ring  object 
at  multiple  wavelengths  were  successfully  reconstructed  using  the  weighted  superposition  of  plasmonic 
output  images  as  specified  in  the  proposed  detection  strategy.  In  addition,  plasmonic  filter  arrays 
were  theoretically  tested  on  a  target  at  extremely  high  temperature  as  a  challenging  scenario  for  the 
detection  scheme. 


Infrared  (IR)  spectral  imagers1-3  have  been  widely  employed  to  detect  the  spectral  content  of  radiation  from 
various  objects  at  several  wavelengths  of  interest.  A  conventional  spectral  imager  collects  a  series  of  images  with 
dispersive  elements  such  as  a  filter  wheel  in  front  of  an  imager  viewing  a  scene.  The  captured  images  contain  nar¬ 
rowband  spectral  responses  of  objects  at  specific  wavelength  locations.  By  employing  a  data  processing  technique, 
spectral  images  are  aligned  in  a  three-dimensional  array  of  values  (termed  a  “data  cube”)  in  order  to  construct  a 
spectrally- resolved  image  of  the  object,  which  is  then  analyzed  to  identify,  for  example,  the  materials  composi¬ 
tions  of  the  object  in  a  scene,  and  enable  discriminating  among  different  classes  of  materials. 

A  new  class  of  IR  sensing  techniques,  termed  algorithmic  spectrometry4-8,  has  been  developed  as  an  alterna¬ 
tive  to  traditional  approaches.  This  novel  approach  is  particularly  designed  for  pixelated  IR  sensors  having  spec¬ 
trally  coarse  and  overlapping  spectral  responsivities  of  the  pixel  types.  The  idea  of  the  algorithmic  spectrometer 
is  to  reconstruct  the  spectrum  of  any  unidentified  object  of  interest  without  utilizing  any  intervening  spectral 
filters  or  equivalent  optics  in  the  optical  train.  A  key  step  is  to  find  the  optimal  set  of  weights  by  the  projection 
algorithm9,  which  enables  the  synthesis  of  a  desired  spectral  shape  (with  a  specified  center  wavelength  and  band¬ 
width)  onto  the  linear  space  spanned  by  the  sensors  spectral  responsivities.  As  a  result,  the  outcome  from  the 
projection  step  is  a  synthetic  spectral  responsivity,  composed  of  a  mathematically  defined  artificial,  arbitrary 
and  hypothetical  bandpass  filter  which  best  approximates  a  desired  spectral  filter  shape.  This  synthetic  spectral 
responsivity  then  serves  as  a  means  for  reconstructing  the  radiation  of  an  unidentified  object  at  a  wavelength  of 
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Wright-Patterson  AFB,  45433,  USA.  4Korea  Research  Institute  of  Standards  and  Science,  Division  of  Convergence 
Technology,  Daejeon,  305-340,  Korea.  *These  authors  contributed  equally  to  this  work.  Correspondence  and 
requests  for  materials  should  be  addressed  to  W.-Y.J.  (email:  woo-yong.jang.ctr.nz@us.af.mil)  orZ.K.  (email:  zahyun. 
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interest  (i.e.,  spectral  signature).  Sensing  in  the  transformed  space  (spanned  by  the  synthetic  spectral  responsiv- 
ity)  is  highly  flexible  since  synthetic  spectral  responsivity  can  be  arbitrarily  changed  in  shape,  center  wavelength, 
or  bandwidth  without  utilizing  any  hardware  or  optical  elements.  In  addition,  the  synthesis  of  the  IR  sensors 
responsivity  naturally  leads  to  significant  data  reduction  since  the  number  of  different  sensor  bands  defined  by 
the  pixel  responses  are  significantly  fewer  in  number  than  in  traditional  spectral  sensing  bands. 

In  the  human  visual  system10,11,  a  similar  mechanism  can  be  observed  in  terms  of  recognizing  the  spec¬ 
tral  contents  of  an  object,  resulting  from  the  interpretation  of  the  spectral  response  of  three  different  types  of 
color-sensing  elements.  Analogous  to  the  functionality  of  the  lens  and  the  film  in  a  camera,  an  image  of  the  visual 
world  is  created  on  the  retina  through  the  cornea.  The  retina  is  the  inner  coat  of  the  eye  consists  of  several  layers 
of  neurons.  Among  them,  the  photoreceptor  cells  are  light  sensitive  elements,  mainly  of  two  types:  rods  and 
cones.  Particularly,  cones  support  daytime  vision  and  the  perception  of  color  with  three  classes,  often  referred  to 
as  the  long  L  peak  in  the  red,  the  medium  M  peak  in  the  green,  and  the  short  S  peak  in  the  blue.  These  three  L, 
M  and  S  cones  display  different,  but  partially  overlapping  response  curves.  This  corresponds  with  our  IR  sensors 
different  pixel  outputs  or  spectral  responsivities.  Despite  the  overlap  in  individual  cone  spectral  responsivities  that 
results  in  redundant  wavelength  sensing,  the  human  visual  system  can  respond  to  variation  in  color  in  different 
ways  due  to  trichromatic  vision.  The  brain  would  not  be  able  to  distinguish  different  colors,  if  the  input  would  be 
from  only  one  type  of  cone  cell,  simply  due  to  lack  of  information.  With  at  least  two  or  three  types  of  cones,  the 
brain,  learning  through  experience,  can  compare  the  signals  from  each  type  of  cone  cell,  and  thereby  determine 
color,  i.e.  both  the  intensity  and  wavelength  of  the  light,  using  combinations  of  neighboring  cell  responses. 

In  recent  years,  the  physical  phenomenon  of  surface  plasmon  (SP)  resonance12-15  has  been  demonstrated 
to  have  a  high  potential  for  use  as  multispectral  (MS)  sensing  elements  or  couplers  for  IR  imagers.  This  is  due 
to  the  ease  of  tuning  the  resonance  wavelength,  and  providing  the  ability  to  design  transmission  and  reflection 
properties,  thereby  offering  different  spectral  shapes  for  a  sensors  responsivities.  The  change  in  SP  resonance 
wavelength  is  mainly  correlated  to  the  structural  periodicity  In  our  recent  publications14-18,  a  2-D  array  of  gold 
(Au)  circular  holes  (CHA)  was  used  as  our  SP  resonance  structure  and  the  periodicity  of  CHA  was  varied  to  tune 
the  SP  resonance  wavelength.  Corresponding  spectral  curves  through  various  CHAs  have  shown  spectral  shifts 
in  the  SP  resonance,  as  well  as  partial  overlaps  between  neighboring  curves  similar  to  the  response  spectra  of  cone 
cells  in  the  human  eye. 

The  IR  retina  concept  (algorithmic  spectrometry)19-21  was  then  implemented  in  order  to  decorrelate  the  over¬ 
lapping  spectra  of  individual  CHAs  through  weighted  combinations  of  the  sensed  outputs  (similar  to  principal 
component  transformation)  just  as  the  human  eye  does.  Results  drawn  from  the  algorithm  successfully  recon¬ 
struct  the  spectral  signatures  of  an  object  at  desired  wavelengths,  along  with  a  reconstructed  spectral  bandwidth 
beyond  the  inherent  characteristics  of  original  CHAs.  Additionally,  the  IR  retina  concept  was  implemented  as  a 
SP-based  superpixel18,  reconstructing  the  objects  signature  both  spatially  and  spectrally  at  a  location  in  the  scene. 
Hence,  forming  different  SP  arrays  over  a  single  imaging  plane  in  conjunction  with  data-processing  algorithm 
enables  real  time,  spatially  resolved  collection  of  the  multispectral  information  content  of  imaged  scenes. 

For  this  paper,  we  present  the  first  experimental  demonstration  of  this  reconstruction  using  an  array  of  SP 
spectral  filters  to  measure  the  radiant  power  from  an  unknown  source  in  a  scene  in  the  long  wave  IR  (LWIR) 
region.  The  LWIR  portion  of  the  electromagnetic  spectrum  is  the  region  of  interest  for  our  specific  effort,  since 
objects  near  room  temperature  emit  thermal  radiation  in  this  range,  allowing  imagery  that  is  largely  independent 
of  illumination  conditions.  Furthermore,  to  clarify  the  difference  between  our  study  and  previous  works  reported 
in  refs  18-20  it  is  worth  noting  that  the  proposed  plasmonic  sensing  strategy  has  not  been  fully  realized  prior  to 
this  work,  i.e.,  the  implantation  and  performance  analysis  of  IR  retina  concept  was  mostly  carried  out  either  with 
a  single  pixel  IR  device  (experiment:  spectrally- reconstructed  targets  signature)19,20  or  with  a  SP-based  superpixel 
(simulation:  spatially-  and  spectrally-reconstructed  target  signatures)18. 

The  paper  consists  of  three  main  sections.  The  first  section  discusses  the  design  and  fabrication  of  the  SP  spec¬ 
tral  filter  arrays  based  upon  a  CHA  structure  with  resonances  in  LWIR  range  (8-12  pm).  The  second  section  is 
about  the  post-processing  strategy  for  LWIR  object  detection  based  on  the  algorithmic  spectrometry  concept.  The 
last  section  is  a  performance  analysis  of  the  proposed  strategy,  using  examples  of  reconstructing  the  irradiance  of 
an  IR  source  (blackbody)  as  well  as  a  metal  ring  object.  Furthermore,  a  simulation  study  is  carried  out  for  poten¬ 
tial  application  of  SP  spectral  filter  arrays  to  detect  objects  at  extremely  high  temperature  in  a  scene  that  would 
typically  saturate  IR  detector  systems. 

Results 

Design  of  an  array  of  SP  spectral  filters.  Prior  to  the  design  of  the  surface  plasmon  (SP)  resonance  struc¬ 
tures,  three  requirements  were  specified  by  the  algorithmic  spectrometer  for  the  object  detection  in  long- wave  IR 
(LWIR).  These  were  SP  resonance  wavelengths,  the  number  of  SP  resonances  within  the  wavelength  range  of  inter¬ 
est,  and  the  bandwidths  of  the  sensors  responsivities  via  SP  resonance  structures.  A  brief  description  of  the  algo¬ 
rithm  will  be  provided  in  the  following  section.  The  SP  resonance  wavelengths  were  set  between  7.5  and  1 1  pm, 
the  number  of  resonances  was  set  to  be  at  least  4  or  greater,  and  the  the  full-width  at  half  maximum  (FWHM) 
bandwidth  required  was  set  to  2  pm  or  less.  Using  these  requirements  as  the  design  criteria,  the  SP  structural  sim¬ 
ulation  was  carried  out  for  a  single  Au  layer  perforated  with  a  2-D  square  array  of  circular  holes  (CHAs).  Finite 
integration  technique22  and  rigorous  coupled  wave  analysis23  based  simulations  were  used,  and  results  obtained 
from  both  techniques  were  comparable. 

For  all  SP  structures,  the  orthogonal  pitches  of  CHAs,  pix  (pitch  along  x- direction)  andpiy  (pitch  along 
y-direction)  are  both  fixed  at p{  (pi=pi,x=pi,y),  where pt  is  varied  from  2.0 pm  to  3.2  pm  with  a  step  of  0.2 pm  and 
the  subscript  i  indicates  the  periodicity  as  shown  in  Fig.  1.  The  SP  resonance  transmission  peak- wavelengths  are 
expected  to  change  with  the  pitch p2;  the  first-order  Xt  ^  0j  and  second-order  A2-  ^  ^  SP  resonances  attribute  to  the 
nearest-  and  next  nearest-neighbor-hole  coupling,  respectively  Their  resonant  transmission  peak- wavelengths  for 
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Figure  1.  A  photograph  of  the  fabricated  array  of  SP  based  spectral  filters,  illustration,  transmission  spectra 
and  LWIR  spectral  responsivities  via  SP  filter  arrays,  (a)  Photograph  of  SP  spectral  filter  arrays  which  consists  of 
seven  different  CHA  structures  (Note:  The  region  enclosed  by  white  dotted  line  shows  the  SP  filters  utilized  for  the 
experiment),  (b)  Geometry  and  dimension  of  CHA  structure  for  each  SP  filter,  p  =  2.0  pm  ~  3.2  pm  with  0.2  pm 
step;  =  0.5  •  p  ;  tAu  =  0.1  pm.  (c)  FTIR- measured  transmission  spectra  (T,-)  through  SP  filter  arrays  shown  in  a. 
The  transmission  measurement  was  carried  out  at  normal  incidence  to  the  sample  then  normalized  to  the 
maximum  value,  (d)  Corresponding  LWIR  spectral  responsivities  of  collected  outputs  at  the  camera  via  SP  filter 
arrays. 


normal  incidence  can  be  calculated  using  the  momentum  matching  condition12  A 
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and  m,  n  are  integers  representing  the  SP  coupling  order.  The  ratio  d/p,-  and  Au  thick- 
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ness  tAu  are  fixed  at  0.5  and  100  nm,  respectively.  As  a  result,  the  first-order  SP  resonance  transmission  was  peaked 
at  ~6.9  pm  (pf  =  2.0  pm)  and  gradually  red-shifted  as  p{  increased.  Note  that  the  FWHM  for  each  CHAs  transmis¬ 
sion  spectrum  was  found  to  be  around  0.6  pm. 

Based  on  simulation  results,  we  fabricated  the  array  of  SP  based  spectral  filters  on  double-side,  polished, 
2-inch,  semi-insulating  GaAs.  A  brief  description  of  the  fabrication  steps  is  provided  as  follows:  (1)  Standard 
photolithography  was  employed  to  produce  periodic  circular  post  array  in  the  photoresist  layer;  (2)  5-nm-thick 
adhesion  layer  of  titanium  (Ti)  and  100-nm-thick  layer  of  Au  were  deposited  using  e-beam  evaporation,  followed 
by  a  liftoff  processing  (CHA  structure  as  displayed  in  Fig.  lb);  (3)  Finally,  a  200-nm  thick  Ti  layer  was  deposited 
to  isolate  the  array  of  SP  spectral  filters  from  incident  IR  radiation  (to  block  the  unwanted  area  from  incident  IR 
light),  which  leads  to  the  final  structure  of  SP  spectral  filter  arrays  as  shown  in  Fig.  la.  A  further  description  is 
included  in  the  Methods  section. 

The  transmittance  of  the  fabricated  SP  spectral  filters  (Fig.  lc)  was  measured  by  using  an  FTIR  spectrometer 
under  an  atmosphere  of  nitrogen  purged  at  30  ~  40  seem,  which  prevents  IR  absorption  by  components  of  ambi¬ 
ent  air.  See  Methods  for  more  details.  The  measured  transmission  spectrum  (T,)  determines  how  much  IR  beam 
is  incident  on  the  LWIR  camera24  through  each  SP  filter.  As  a  result,  the  spectral  responsivity  (R,) ,  i.e.  the  camera 
output  due  to  IR  beam  transmitted  via  each  SP  filter  is  established  by  relating  T,  to  the  relative  responsivity  of  a 
LWIR  camera  Rlwir  as  Rz  =  T,  •  Rlwir-  All  spectral  responsivities  (Fig.  Id)  transmitted  via  an  array  of  SP  filters 
were  obtained  after  repeating  the  FTIR  measurements.  Note  that  in  Fig.  lc,  it  can  be  clearly  seen  that  the  meas¬ 
ured  1st  order  SP  resonance  peak  redshifts  from  6.9  pm  to  10.8  pm  as  the  pitch  is  increased  from  2.0  pm  to  3.2  pm, 
as  previously  expected.  More  details  of  Fig.  lc,d  are  included  in  the  Supporting  Information  section. 


Target  detection  strategy  using  SP  filtered  outputs.  Our  strategy  is  based  upon  the  principle  that  by 
performing  a  weighted  linear  combination  of  pixel  level  signal  responses  through  the  SP  filters,  the  incident  power 
per  unit  area  from  an  unknown  object  at  a  specific  wavelength  can  be  identified.  As  illustrated  in  Fig.  2,  the  iden¬ 
tification  process  is  carried  out  in  three  major  steps:  (1)  Pre-processing;  (2)  Measurement,  and  (3)  Post-processing. 
A  detailed  description  follows.  The  pre-processing  involves  the  specification  of  desired  spectral  filters  (i.e.,  shape, 
center  wavelength  and  bandwidth)  and  the  calculation  of  projection  weights.  It  is  worth  pointing  out  that  the 
pre-processing  step  is  performed  independently  of  source  information.  Once  filter  parameters  are  set,  the  projec¬ 
tion  algorithm  estimates  a  filter  shape  in  a  minimum  mean  square  error  sense  by  calculating  a  set  of  weights  in 
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Figure  2.  Block  diagram  illustrating  a  target  detection  strategy  using  an  array  of  seven  SP  filters  to  identify 
the  incident  power  from  an  unknown  source  at  a  specific  wavelength.  The  zth  SP  filter  in  the  array  is  labeled  as 
CHAZ.  The  strategy  comprises  the  preprocessing,  measurement  and  post-processing. 


which  each  weight  corresponds  to  individual  spectral  responsivity  associated  with  CHAZ.  By  drawing  freely  from 
ref.  19,  a  set  of  weights  w,-  corresponding  to  the  desired  spectral  filter/  (a  matrix  form  of  /.  (A;  \  peak))  is  com¬ 
puted  according  to  the  following  equation, 


w,  =  [R^r'Ry,  (i) 

where  R  is  the  vector  of  spectral  responsivities  for  incident  power  transmitted  via  SP  filters.  A  description  of  the 
projection  algorithm  for  wf  is  available  in  the  Supporting  Information  section. 

A  linear  combination  of  responsivity  spectra  in  R  with  w,-  optimally  approximates  the  desired  filter  /  with  a 
synthetic  spectral  filter,  f.  ^A;  Az-  peak ^  ”=i  wi  jR/(  A)  where  wi,j  and  R,-(A)  are  the/h  component  in  w,-  and  R, 

respectively.  This  filter  f.  is  what  we  would  employ  for  extracting  the  spectral  content  of  a  source  from  the  scene 
at  a  specified  wavelength  (Az-  peak  «  A{  peak).  The  calculation  is  repeated  to  obtain  the  weight  vector  w  (i.e.  a  collec¬ 
tion  of  w i)  for  the  remaining  spectral  filters  of  interest  in  the  filter  set  F,  yielding  a  group  of  weight  sets.  In  the 
measurement,  the  output  (Vt)  is  taken  when  each  SP  filter  (i.e.,  CHAZ)  is  exposed  to  a  test  scene  with  a  radiating 
source  of  interest.  In  the  post-processing  step,  a  collection  of  sensed  outputs,  V  =  Vn],  where  n  is  the 

number  of  SP  filters  applied  is  linearly  synthesized  with  weights  wz.  This  synthetic  output  is  then  transformed  into 
the  power  per  unit  area  per  wavelength  (W/m3)  according  to  the  relationship  P}  =  ^ j=1  W|,;^V|yhere  Ar  is  a 

J  i  A  jr  Ji 

relating  (normalizing)  factor  and  is  equal  to  the  area  under  measured  responsivity  curve  via  synthetic  filter/.. 
This  reconstructed  power  Pj  corresponds  to  the  property  that  we  would  have  probed  using  a  broadband  LWIR 
camera  looking  at  the  same  source  directly  through  the  synthetic  filter  /  .  To  reconstruct  the  incident  radiation  at 
multiple  peak- wavelengths  Az-  peak ,  the  post-processing  needs  to  be  repeated  using  different  weight  sets  wz.  By 
doing  so,  multiple  sets  of  weights  can  be  determined  corresponding  many  wavelengths  that  can  be  independently 
reconstructed  from  a  single  measurement  set. 

Test  scenario  I:  Multispectral  reconstruction  of  blackbody  radiation.  As  a  proof  of  concept  for  our 
detection  strategy  explained  in  previous  section,  we  specified  a  test  scenario  as  follows.  The  blackbody  was  used 
as  an  unknown  test  source  and  set  to  radiate  at  300  °C.  For  measurement,  we  placed  the  fabricated  array  of  seven 
SP  spectral  filters,  CHA^  . . . ,  CHA7  (as  shown  in  Fig.  la)  in  front  of  the  LWIR  camera  looking  at  a  blackbody 
source.  Experimental  outputs  Vexp  =  [Vl--  V7\  were  then  collected  at  the  camera  as  each  SP  spectral  filter,  CHAZ- 
was  exposed  to  the  scene  (moving  from  CHA1  to  CHA7),  as  illustrated  in  Fig.  2. 
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Figure  3.  Multispectral  reconstruction  of  blackbody  (used  as  an  unknown,  simple  thermal  source) 
information  using  the  detection  strategy  described  in  previous  section.  Preprocessing:  The  desired  triangular 
shaped  filters  (/ .  where  i  =  1  ~  6:  in  black)  with  a  fixed  FWHM  of 420  nm  and  synthetic  filters  (/ .  where  i  =  1  —  6: 
in  color)  with  FWHMs  varying  from  260  nm  to  490  nm  (differences  in  peak- wavelengths  and  FWHMs  are 
Wpeak  -  \tpeak\  =  0>  90, 40,  70, 0, 20 nm  and  | FWHMj  -  FWHM^  |=  160, 70, 60, 100, 20, 40 nm,  respectively). 
The  projection  errors  (ei  .  «  | / .  —  /.  |)  are  calculated  with  respect  to  the  desired  triangular  shaped  filters,  ranging 
from  4.5%  to  19.7%.  Measurement:  Seven  sensed  outputs  in  °C  (is  converted  into  V/m2)  as  a  blackbody  radiates 
through  each  CHAf.  Measurement  was  repeatedly  performed  as  moving  from  one  CHAf  to  another  sequentially. 
Post-processing:  Reconstructed  blackbody  radiation  Pj  at  six  different  wavelengths  X1  peak  •  •  •  A6  peak  and  the 
reconstruction  errors  (g.  rec  ^  |  Pj  —  Pf  |)  as  compared  to  the  reference  Pj .  Corresponding  weight  sets  wy  •  •  w6  are 
used  to  reconstruct  the  multispectral  property  of  an  unknown  thermal  source  (blackbody)  in  the  LWIR.  The  table 
summarizes  all  the  preprocessed  and  post-processed  results  by  our  detection  strategy  in  order  to  characterize  the 
unknown  source. 


In  the  top  right  panel  of  Fig.  3,  measured  outputs  Vexp  in  V/m2  through  SP  filter  arrays  are  plotted  as  a  function 
of  CHAs  pitch  for  each  SP  filter  since  the  pitch  variation  is  the  main  factor  to  produce  seven  SP- filters  (corre¬ 
sponding  to  designed  SP-spectral  responsivities  as  previously  explained).  In  Fig.  3,  the  measured  outputs  Vexp  are 
also  plotted  with  theory  Vtheo  for  validation  (Calculation  of  Vtheo  is  included  in  Supporting  Information  section). 
As  observed  in  Fig.  3,  the  overall  trend  as  a  function  of  CHAs  pitch  is  consistent  between  theory  and  experiment. 
However  a  discrepancy  between  Vexp  and  Vtheo  is  possibly  due  to  two  reasons:  one  is  the  imperfections  in  the  fab¬ 
rication  of  SP  filter  arrays  and  the  other  is  Vtheo  was  simulated  under  normal  incidence  while  Vexp  was  measured 
with  the  LWIR  camera  which  was  slightly  angled  to  face  the  SP-filter  arrays  to  avoid  the  significant  reflection  at 
the  surface. 

While  the  blackbody  source  information  is  assumed  unknown,  the  objective  is  to  spectrally  reconstruct  the  inci¬ 
dent  radiation  of  the  source  at  multiple  wavelengths  in  order  to  establish  what  it  is.  For  this  scenario,  we  specified  six 
desired  triangular  filters  [f1  •  •  •  /6  ]  in  the  preprocessing  step  of  our  strategy  for  multispectral  reconstruction  of  an 
unknown  source.  Six  desired  filters  have  peak- wavelengths  at  Xipeak  =  7.87,  8.3,  8.9,  9.5, 10.1, 10.77  pm,  respectively 
and  each  has  a  FWHM  of 420  nm  as  shown  by  solid  black  lines  in  the  top  left  panel  of  Fig.  3.  To  realize  these  desired 
filters/,  six  synthetic  filters  \fl  •  •  •  f  ]  were  designed  by  finding  corresponding  weight  vector  w  (a  set  of  wf)  according 
to  the  solution  in  equation  (1)  for  the  projection  algorithm.  By  comparison  between  /  and/.,  the  errors  in 


peak-wavelengths 


Ai.peafc  ^i,peak\ 


<  0.011 


' i,peak 


and  FWHMs 


=  0.38,  0.17,  0.14,  0.24,  0.05,  0.1 


were  reasonably  low.  In  addition,  the  overall  errors  described  by  the  shape  matching  error  e{  (i.e., 


<*>-/,  (A) )' 

—  Amin  V  / 


d\ 


i, pro)  ' 


reported  in  ref.  18)  in  the  table  of  Fig.  3  were  also  acceptable  having  a  minimum  of 


J/max  f.2(X)dX 

4.5%  for  f2  and  a  maximum  of  19.7%  for /g. 

In  the  post-processing  step,  the  measured  SP  outputs  in  Vexp  were  multiplied  by  pre- determined  weights  in 
each  w,-  then  summed  (i.e.,  ^  J=1  w^Vj),  yielding  a  set  of  synthetic  outputs.  Each  synthetic  output  was  trans¬ 
formed  into  the  value  in  W/m3  using  a  relating  factor  A{,  hence  reconstructing  the  radiation  of  a  blackbody  source 
at  a  wavelength  of  Xt  peak  (i.e.,  Pj ).  The  post-processing  step  was  repeated  for  entire  set  of  weights  wl  •  •  •  w6  to 
reconstruct  the  source  radiations  at  six  different  peak  wavelengths  Ax  peak  •  •  •  \peak.  The  table  in  Fig.  3  lists  the 
reconstructed  blackbody  radiations  Pj  •••  Pj  after  post-processing  as  well  as  comparison  to  the  ground 


truth Pf  ...  Pf 

j  i  j  i,  - , 

More  detail  about  the  ground  truth  are  available  in  the  Supporting  Information  section. 


Each  reference  P j  corresponds  to  the  reconstructed  radiation  using  an  ideal  triangular  filter/.. 
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Figure  4.  Reconstructed  multispectral  LWIR  images  of  a  metal  ring  object.  The  spatial  and  spectral 
properties  were  reconstructed  using  six  synthesized  spectral  filters  (shown  in  the  top  left  panel  of  Fig.  3)  by 
means  of  our  detection  strategy  (using  seven  SP-filters  array)  at  six  different  wavelengths  (7.87,  8.21,  8.86,  9.43, 
10.1,10.75  pm). 


We  achieved  a  reconstruction  error  (i.e.,  e{  rec  «  | Pj  —  Pf  |)  as  low  as  around  2%  at  X2  =  8.21  pm.  It  is  impor¬ 
tant  to  mention  that  the  reconstruction  errors  greater  than  0  are  attributed  to  a  couple  of  factors:  first,  is  the 
imperfection  in  the  projection  of  a  desired  spectral  filter  f.  since  the  projection  error  (eiproj  «  | f .  —  f .  |  >  0) 
and,  second,  is  the  experimental  uncertainty  in  Vexp  as  compared  to  Vtheo. 

Test  scenario  II:  Reconstructed  multispectral  LWIR  images  of  a  metal  ring  object.  Further  eval¬ 
uation  was  carried  out  by  creating  a  different  test  scenario  with  a  metal  object  placed  between  a  blackbody  and 
CHA*.  In  the  measurement,  seven  output  images  Vexp  =  [  V1  •  •  •  W7j  as  shown  in  Fig.  4,  were  captured  as  the  seven 
SP  filters  (CHA^7)  were  sequentially  placed  in  front  of  a  new  test  scene.  Each  output  image  shows  a  metal  ring 
object  under  blackbody  illumination.  Note  that  the  LWIR  camera  records  a  320  x  240  pixel  image,  however  the 
region  that  captured  the  metal  coil  consists  of  10  x  10  pixels.  For  reconstructions  at  Ax  peak  •  •  •  A6  peak ,  the  same  sets 
of  weights  wp  •  •  w6were  applied  and  each  was  synthesized  withVexp.  Resulting  from  weighted  synthesis,  the  six  recon¬ 
structed  images  were  obtained  including  the  spatial  and  spectral  properties  of  a  metal  ring  under  the  blackbody 
background.  Images  at  A2  peak  =  8.21  pm  and  A3  peak  =  8.86  pm  indicate  good  reconstructions,  which  is  attributed 
to  the  low  projection  errors  (4.5%  and  5.7%)  in  the  preprocessing  of  our  detection  strategy  On  the  other  hand, 
an  artifact  was  observed  in  the  image  at  X6ypeak  =  10.75  pm,  showing  a  poor  reconstruction.  This  is  because  the 
quality  of  synthetic  filter  f6  ^A;  X6peak ^  is  not  of  sufficient  quality,  since  the  projection  error  e6proj  is  relatively 
high,  at  almost  20%  compared  to  the  desired  spectral  filter  /  .  The  limitation  of  synthetic  filter  approximation  was 
clearly  evident  beyond  10.75  pm  because  there  was  a  lack  of  spectral  responsivities  or  information  provided  by 
seven  SP  filters.  To  improve  the  quality,  the  resonance  range  of  SP-filter  structures  must  be  extended  to  longer 
wavelengths  and  we  expect  this  will  resolve  artifacts,  such  as  the  one  observed  at  10.75  pm. 

Multispectral  detection  of  an  extremely  hot  object  using  proposed  plasmonic-algorithmic 
spectrometer.  The  proposed  target  detection  strategy  (based  on  the  fabricated  SP  filter  arrays  and  algorith¬ 
mic  spectrometer)  was  successfully  demonstrated  for  a  simple  thermal  source  and  a  metal  ring  object.  This  suc¬ 
cess  motivated  us  to  apply  the  detection  strategy  towards  target  detection  under  extreme  conditions  (e.g.,  target 
temperature  >1000°C).  To  create  a  test  scenario,  an  IR  radiation  source  was  again  assumed  to  be  unknown  and 
characterized  by  Planck’s  law  with  the  blackbody  temperature  varied  from  350  to  1550  °C  in  50  °C  steps,  and 
moreover  we  assumed  that  the  plasmonic  detector  system  is  used  for  remote  sensing  of  an  extremely  hot  object 
(i.e.,  our  detector  system  is  not  directly  exposed  to  the  extremely  high  temperature  or  it  is  not  enclosed  in  the 
extremely  high  temperature  environment).  For  detection  purpose,  the  desired  LWIR  spectral  filter  /  (A;  Xpeak) 
was  specified  with  a  triangle  shape,  a  peak  at  Xpeak  =  8.6  pm  and  a  high  resolution  with  FWHM  =180  nm.  By  pre¬ 
processing,  this  filter  was  estimated  to  be  /  ( A;  Xpeak)  with  Xpeak  =  8.62  pm  and  FWHM  =190  nm  using  a  set  of  61 
SP- spectral  responsivities,  R  =  [Rx  •  •  •  ff61]  as  shown  in  Fig.  5a  (Note:  Simulation  of  61  SP-spectra  is  available  in 
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Figure  5.  Proposed  plasmonic-algorithmic  spectrometer  to  detect  objects  at  extremely  high  temperature. 

(a)  Preprocessing  using  a  set  of  SP-spectral  responsivities  R  =  [Rx  •  •  •  R61]  to  design  a  triangular  narrowband 
filter  /  (A;  \Upeak) with  \ipeak  =  8  .62  pm  and  a  high  resolution  FWHM  =190  nm.  (b)  Successful  reconstructions 
(reconstruction  error,  e,  «  1%)  of  source  radiations  at  A,-  ^n1r  =  8.62  pm  as  temperature  varied  from  350  to 
1550  °C  with  a  step  of  50  °C.  ' 


the  Supporting  Information  section).  The  corresponding  weight  set,  w  was  obtained  and  the  projection  error  was 
0.82%.  For  each  target  (blackbody)  temperature  z,  SP-outputs  Vsim  /  =  [Vx  i  •••  V6l  i]  were  obtained,  and  then 
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linearly  synthesized  with  weights  w  for  reconstructing  the  source  radiation  at  Xpeak  =  8.62  [im.  Figure  5b  shows 
that  the  reconstruction  is  in  good  agreement  with  the  true  values  in  extremely  high  temperature  range. 

Discussion 

The  capability  of  synthesizing  spectral  filters  using  plasmonic  spectral  filter  arrays  for  LWIR  target  detection 
was  demonstrated.  For  the  experiment,  seven  different  plasmonic  structures  based  on  a  circular  hole  array  were 
fabricated  on  a  GaAs  wafer.  Band-pass  filtered  responsivity  curves  from  the  plasmonic  filter  arrays  were  meas¬ 
ured  showing  a  first-order  SP  resonance  tuned  in  the  7.5-1 1  pm  range.  A  new  concept  in  IR  sensing  technique 
called  algorithmic  spectrometry  (or  the  IR  retina  concept)  was  applied  to  decorrelate  the  spectral  redundancy 
present  in  the  sensed  data,  as  the  responsivity  curves  of  the  plasmonic  filter  arrays  are  partially  overlapping.  The 
decorrelation  process  was  done  by  performing  a  weighted  linear  synthesis  among  output  images  captured  by  an 
LWIR  camera  as  seen  through  the  plasmonic  filter  arrays.  The  synthetic  outputs  reconstructed  incident  radiation 
from  targets  at  a  specified  LWIR  wavelength  location.  For  demonstration,  radiation  from  a  blackbody  and  a  metal 
object  were  reconstructed  successfully  at  different  wavelength  locations  7.87-10.75  pm.  Moreover,  the  potential 
application  of  plasmonic  filter  arrays  for  detecting  targets  at  extremely  high  temperature  was  addressed  by  recon¬ 
structing  a  radiation  of  target  in  the  range  of  350-1550  °C. 

Methods 

Fabrication  procedure  of  SP  filter  array  based  on  CHA  structure.  We  fabricated  a  single  gold  layer 
perforated  two-dimensional  square  array  of  circular  hole  arrays  (CHAs)  with  seven  different  periods  ( p  =  2.0  mm 
to  3.2  pm  with  a  step  of  0.2  pm;  the  size  of  each  CHA-units  is  1  x  1  cm2)  on  a  double-side  polished  350  pm-thick, 
2-inch  semi-insulating  GaAs  wafers  with  etch  pit  density  (EPD)  of  <5000.  The  bare  wafer  was  cleaned  with  a 
standard  wet-cleaning  procedure  using  acetone,  methanol,  and  deionized  (DI)  water  for  three  minutes  for  each 
step,  followed  by  a  nitrogen  blow-off.  For  good  adhesion  of  AZ5206  photoresist  (PR)  to  the  wafer,  hexamethyld- 
isilazane  (HMDS)  was  spin-coated  using  a  spinner  at  5Krpm  for  30  s  and  then  the  wafer  was  hotplate-baked 
at  100  °C  for  60  s.  After  that,  the  wafer  was  spin-coated  with  AZ5206  PR  at  5Krpm  for  50  s  and  baked  on  a  hot 
plate  at  100 °C  for  60s.  Conventional  photolithography  process  was  then  employed  to  precisely  pattern  the 
CHAs  on  the  wafer  surface  using  a  Karl  Suss  MJB-3  mask  aligner  with  a  UV  mercury  lamp  (200  W).  The  wafer 
was  exposed  to  the  UV  radiation  with  an  exposure  density  of  6mW/cm2  for  23  s.  The  exposed  wafer  was  hot- 
plate-baked  at  1 12  °C  for  90  s  and  flood-exposure  was  performed  for  200  s  to  reverse  the  polarity  of  the  positive  PR 
to  the  negative,  which  is  known  as  image  reversal  process  (This  image  reversal  process  readily  enabled  fabricating 
small-featured  patterns,  facilitating  a  lift-off  process).  The  image  reversal  processed  sample  was  developed  in  a 
diluted  developer  (AZ340  developer  :DI  water  =  1:6)  for  40  s.  For  metallization  of  the  CHAs,  two  metal  layers  of 
Ti  (5  nm)/Au  (100  nm)  were  deposited  on  the  wafer  by  an  electron-beam  evaporator.  Ti  was  used  to  enhance  the 
adhesion  between  Au  and  GaAs  in  the  metallization  process.  Then,  a  standard  lift-off  process  using  acetone  was 
applied  to  form  the  CHAs.  Additional  Ti  metal  layer  (200  nm)  was  deposited  by  an  electron-beam  evaporator  on 
area  that  has  not  been  shaped  CHAs. 

FTIR  transmission  measurement.  The  transmission  of  the  fabricated  SP  filter  array  consisting  of  CHAs 
with  seven  different  periods  was  measured  using  a  Thermo  Scientific  Nicolet  5700  FTIR  spectrometer  under 
nitrogen  atmosphere  of  30-40  seem  to  prevent  infrared  absorption  by  air.  The  transmission  measurement  was 
carried  out  at  normal  incidence  to  each  CHA-units  and  was  normalized  to  a  single  beam  transmission  spectrum 
of  a  bare  GaAs  wafer  which  was  first  measured  as  a  background  spectrum.  As  expected,  the  experimental  results 
showed  that  the  SP  resonance  wavelength  were  red-shifted  with  increasing  the  periodicity  of  the  CHAs  (Fig.  lc). 
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